Analysis of Nonlinear Synchronization Dynamics of Oscillator Networks by Laplacian 

Spectral Methods. 
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Abstract 

We analyze the synchronization dynamics of phase oscillators far from the synchronization manifold, including the onset of 
synchronization on scale-free networks with low and high clustering coefficients. We use normal coordinates and corresponding 
time-averaged velocities derived from the Laplacian matrix, which reflects the network's topology. In terms of these coordinates, 
synchronization manifests itself as a contraction of the dynamics onto progressively lower-dimensional submanifolds of phase 
space spanned by Laplacian eigenvectors with lower eigenvalues. Differences between high and low clustering networks can be 
correlated with features of the Laplacian spectrum. For example, the inhibition of full synchoronization at high clustering is 
associated with a group of low-lying modes that fail to lock even at strong coupling, while the advanced partial synchronization 
at low coupling noted elsewhere is associated with high- eigenvalue modes. 

PACS numbers: 89.75.Hc, 05.45.Xt 



The relation between structure and function is a key 
area in the study of complex networks [1] 2] 3] 4]. Syn- 
chronization of coupled oscillators || has applications to 
numerous areas of biology including neuroscience, as well 
as systems such as coupled lasers and Josephson junc- 
tions, and accordingly its dependence on coupling topol- 
ogy has begun to receive attention. Among methods of 
studying synchronization, the Master Stability Function 
(MSF)[6| formalism is appealing because it expresses the 
dynamical synchronizability in terms of purely structural 
features, independent of details of node dynamics. The 
so-called propensity for synchronization (an indication of 
the size of the parameter range giving a stable synchro- 
nized state) depends only on the extremal eigenvalues 
of the Laplacian matrix. Within this formalism, the 
effects of small-world properties, heterogeneity and cer- 
tain types of weighted coupling have been examined. [|[ Q 
The MSF, however, is restricted to the linear domain, 
close to exact amplitude and phase synchronization of 
chaotic oscillators. Others @ [l(| [H | 12] 3 have ex- 
amined numerically and analytically the onset of syn- 
chronization for phase oscillators coupled on networks, a 
problem for which the MSF is unsuited. 

In this report we demonstrate an application of the 
Laplacian spectrum to a sparsely connected network Ku- 
ramoto [l4[ model both close to and far from full syn- 
chronization. As a case study, we examine scale-free 
networks with low and high clustering coefficients, exam- 
ined elsewhere by different methods[12|. Parametrizing 
the phase space with normal coordinates based on Lapla- 
cian eigenvectors, we show in these two sample cases 
that with increasing coupling strength, the dynamics 
contracts onto progressively lower-dimensional subspaces 
spanned by lower- lying (less stable) eigenvectors. Dy- 
namical properties of the networks can be correlated with 
specific features of their spectra. By focusing on appro- 
priately chosen collective degrees of freedom (the nor- 
mal coordinates) , our approach complements methods of 
analysis that focus on the locking and unlocking of in- 
dividual oscillators [HQ. In the spirit of the MSF, 



our analysis highlights the effects of network topology 
via the spectrum, but in contrast it applies to a range of 
desynchronized and partly synchronized states, not only 
to incipient deviations from full synchronization. We 
consider the the spectrum in its entirety, not only the 
extremal eigenvalues. The coordinates derived from the 
Laplacian spectrum provide a helpful empirical tool for 
the analysis of simulation results. We use them here to 
gain new insight into the different behaviors of networks 
with high and low clustering coefficients. Our empha- 
sis is on the process of synchronization, rather than on 
rigorous bounds for the threshold of desynchronization. 

We first define the model and show how the Laplacian 
and its spectrum appear naturally in a linearized descrip- 
tion of the frequency-synchronized state. Then we use 
the Laplacian eigenvectors to parametrize the partially 
desynchronized states and show that this coordinate sys- 
tem remains useful well beyond the range of validity of 
the linearization. 

Our modelQ is defined by the coupled equations 



d<t>j 
dt 



(i) 



where <pi are TV phase variables (one associated with each 
node of a network), — 1 < uii < 1 are the randomly and 
uniformly distributed intrinsic frequencies 1 , (3 is the over- 
all coupling strength, and is the weighting matrix of 
the individual couplings. In our examples, all links are 
weighted equally, and ay is simply the adjacency matrix 
(aij = 1 if i and j are connected, otherwise). As in [l(| 
and [l2| the coupling strength is normalized by the aver- 
age degree (k) of all nodes. 2 At low coupling strength, 



1 The average of can be taken to be uJ = without loss of 
generality (if it is not zero it can be made so by changing variables 
into a rotating frame of reference.) 

2 By normalizing the average total input to a unit this convention 



1 



each oscillator moves independently at its intrinsic fre- 
quency, but as the coupling increases some become mu- 
tually entrained. At sufficiently strong coupling, all 
oscillators rotate at the same frequency, = Zu = 0. 
For the original, fully connected model the steady-state 
phases depend only on the intrinsic frequencies Wj: those 
with higher frequencies lead the ensemble while those 
with lower frequencies lag. In the present sparsely con- 
nected version, on the other hand, each oscillator is in- 
fluenced differently by its local neighborhood. If the 
phase differences are small then the sine coupling func- 
tion can be approximated linearly and the equations of 
motion become 
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where 



(2) 



(3) 



Low clustering 
(NSFN) 



High clustering 
(CSFN) 



Coupling strength p 

FIG. 1: Synchronization order parameter as a function of cou- 
pling strength for the two scale-free networks. The strongly 
clustered network (CSFN) undergoes a partial synchroniza- 
tion at lower coupling strength, but at higher couplings it is 
significantly less synchronized than the normal (NSFN) net- 
work. 



is the Laplacian matrix. The degree ki of the ith node is 
defined as the number of nodes to which it is connected, 
and the second equation in ^ thus holds if the couplings 
are equally weighted. 

The steady-state (frequency locked) phases can be 
found by diagonalizing the Laplacian. Let its normal- 
ized eigenvectors and corresponding eigenvalues be v Q 
and A Q , where 1 < a < N. Enumerating lattice sites by 
Latin indices and Laplacian eigenvectors by Greek ones, 
we define projections of the phase and frequency vectors 
onto these eigenvectors by 



(4) 



which allows the equations of motion ([2]) to be rewritten 
as 



dt 



(5) 



The steady state values 4> a of the normal coordinates are 
given by 



v (3X a 
Relaxation to this equilibrium obeys 
dx a _/3\ a a 

~~dT ~ ~Jkj~ x 



(6) 



(7) 



where x a = <f> a — (f> a is the displacement from equilibrium 
along the cv-th normal coordinate. The equilibrium is 



facilitates comparisons among networks and corresponds to the 
normalization by N in the original fully connected Kuramoto 
model. 



stable provided all X a > and the phase displacements 
are small enough for the linear approximation to hold. 
By the definition l[5]). the row sum J^. of the Lapla- 
cian is zero for all rows and therefore (1, 1, ...1) is always 
an eigenvector with eigenvalue 0, but for a connected 
network, all other eigenvalues are positive (HI . There- 
fore, the frequency synchronized state is neutrally stable 
against a uniform shift of all phases, but stable against 
all other perturbations. The stability breaks down only 
due to nonlinear effects: the slope of the sinusoidal 
coupling function decreases with increasing phase differ- 
ences and eventually ceases to provide sufficient restoring 
force. Since the phase displacements are largest along 
the eigenvectors with lowest A Q , these eigenvectors rep- 
resent modes along which frequency synchronization first 
fails as the coupling decreases. 

Although they arise most naturally from the linear 
analysis, the Laplacian eigenvectors retain their useful- 
ness beyond that approximation. To demonstrate this, 
we consider two networks as examples. Our two net- 
works have identical, scale-free, degree distributions but 
differ in their clustering coefficient Q[3 — a measure 
of the likelihood that two neighbors of a given node are 
also directly connected to each other, or a measure of the 
prevalence of triangles in the network topology. The first 
is a Barabasi- Albert [13] scale-free network of N = 1000 
nodes with average degree (k) = 20, grown by means of 
preferential attachment beginning with a fully connected 
core of m = 10 nodes. The Barabasi- Albert network has 
a low clustering coefficient, approximately 0.02. The 
other network is derived from the first by applying Kim's 
[IH stochastic rewiring method to increase the clustering 
coefficient to 0.62, without changing the degree distribu- 
tion (although, as mentioned below, some other proper- 
ties vary in tandem with the clustering). We will refer to 
these networks as the normal scale-free network (NSFN) 
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and the clustered scale- free network (CSFN) respectively. 
These were among the networks studied previously in 
[13], where it was found that increased clustering in- 
hibited full synchronization at high (3 but surprisingly 
promoted the onset of partial synchronization at low /3. 
This behavior is shown in a plot (Fig. 1) of the standard 
synchronization order parameter 



(A) 



£< 



(8) 



(where (..) T stands for a time average) as a function of the 
coupling strength. In the unsynchronized state at low 
coupling, r = 0(l/yN) from both networks. The onset 
of synchronization is shown by an upward turn in the plot 
of r vs. (3. This transition occurs at a lower (3 for the 
CSFN than for the NSFN, so that for 0.25 < /3 < 0.75, r 
is larger for the CSFN. At higher couplings, however, the 
CSFN strongly resists full synchronization and remains 
in a partly synchronized state with a much smaller value 
of r than for the NSFN. 

The Laplacian eigenvalue spectra of the NSFN and 
CSFN are shown in figure 2. Like the degree distri- 
bution, the distribution of eigenvalues has a power-law 
tail in both cases. An important difference appears at 
the lower end of the spectrum. In the NSFN, there is 
a gap between the lowest nonzero eigenvalue and zero, 
and the single peak of the distribution is near this lower 
cut-off. The CSFN spectrum, on the other hand, has a 
second peak close to zero, indicating a number of nearly 
degenerate quasi-zero modes. The presence of eigenval- 
ues close to zero indicates that the network has a strong 
community structure, [2(| i.e., it consists of components 
(communities) that have fewer connections between dif- 
ferent components than within each component. In 
fact, the low eigenvectors of the Laplacian form the ba- 
sis of some algorithms for detecting communities [l9] [20] 
From the spectrum, then, we learn that the rewiring al- 
gorithm has not only created clustering (a local property 
measuring the number of triangles) but as a byproduct 
has also created global communities. Since higher clus- 
tering means more "local" connections at the expense 
of long-range ones, this is not surprising, but neither is 
it inevitable — for example, a regular rin g or a "small- 
world" network of the type considered in [l6[ has high 
clustering but no communities. 

To further aid in analyzing the dynamics we define the 
observed frequencies (rotation numbers) of the oscillators 
as the time averages 



dcpj 
~dt 



(9) 



Projecting the vector of observed frequencies onto the 
Laplacian eigenbasis gives a time-averaged velocity along 
the direction defined by each eigenvector: 
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FIG. 2: Histograms of the scaled Laplacian eigenvalues 
\ a / (k) for the NSFN (A) and CSFN (B). Both histograms 
have power-law tails at large eigenvalues. A key difference is 
the group of low-lying modes, separate from the main spec- 
trum, in the highly clustered network. 



In a fully frequency-synchronized state, il a = for 
all a. In figure 3 ensemble averages of the squares of 
the velocities [(fi a ) 2 ] are plotted against the eigenval- 
ues A" for both networks at three values of the coupling 
strength. The average [..] is over 25 different realiza- 
tions of the random frequency distribution. In a case 
where the network is almost completely incoherent (for 
example, the NSFN at (3 = 0.5), all velocities fl a are 
random and of approximately equal magnitude. In the 
case of full synchronization (NSFN at (3 — 2.5), all ve- 
locities are "locked" at zero. At intermediate values 
af (3, however, some modes are locked while others are 
"drifting" at nonzero velocities. It is clear from the 
plots that as the coupling increases, modes with higher 
eigenvalues lock sooner than those with lower ones - 
synchronization proceeds from the top of the spectrum 
downward. Synchronization manifests itself as a progres- 
sive contraction of the dynamics onto lower-dimensional 
submanifolds of the phase space. 

In the case of the CSFN, higher modes begin to lock 
more readily than in the NSFN, indicating that these 
high modes in the spectrum are implicated in the ad- 
vanced partial synchronization of the clustered network 
(fig. [I]). At stronger coupling, on the other hand, the 
most notable difference of the clustered from the nor- 
mal network is that the low-lying modes associated with 
community divisions (fig. [2]) continue to drift while all 
others are locked. The lack of synchronization is as- 
sociated with these low-lying modes, and the frequency 
clusters noted in this case [l2| coincide with topologi- 
cal communities. The observation that these low-lying 
modes fail to lock is consistent with our intuition based 
on the linear approximation, according to which these 
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FIG. 3: Mean square projections of observed frequency differ- 
ences onto Laplacian eigenvectors (normal velocities) at sev- 
eral values of coupling strength /3. Each point represents an 
average over 25 realizations of the random intrinsic frequen- 
cies. In both types of networks, velocities along the eigen- 
vectors with higher eigenvalues vanish at lower couplings than 
those with lower eigenvalues. In the highly clustered network 
(right column), two features are notable: The higher mode 
velocities vanish more readily than for the low-clustering net- 
work, and the lowest lying modes maintain nonzero velocities 
even at f3 = 2.5 where all others vanish. 



modes represent the strongest potential instabilities of 
a synchronized state. Their presence in the spectrum 
accounts for the inhibition of full synchronization in the 
CSFN. The finding that different sets of eigenvectors 
are involved in the two regimes supports the claim (l3j 
that two separate effects are at work, with the advanced 



onset being an effect of the clustering per se, which is 
a local property, while the delay of full synchronization 
results from global topological properties that are cor- 
related with clustering. In particular, the delay was 
ascribed to effects of increasing average path length [l3|. 
However, the involvement of the low eigenvectors asso- 
ciated with communities and the dymanical fragmenta- 
tion of the network into synchronized subgroups suggest 
that it is more specifically a function of the community 
structure (although the latter certainly is correlated with 
a long average path length). Ongoing studies aim to 
further disentangle the various correlated topological fea- 
tures and their effects. 

Examining the dynamics in terms of normal coordi- 
nates defined by the Laplacian eigenvectors provides a 
geometric basis for viewing the flow of the ensemble of 
oscillators that complements other tools of analysis such 
as global order parameters [f| or scatter plots of observed 
vs. intrinsic frequencies of individual oscillators [l^. 
Like the MSF formalism, it gives a partial picture of how 
purely structural features influence the synchronization 
dynamics, since the Laplacian reflects only the network 
topology. It is not obvious a priori that Laplacian eigen- 
vectors should be relevant beyond the range of validity of 
the linear approximation near a fully phase-synchronized 
state, yet the normal coordinate velocities, in particu- 
lar, contain nontrivial dynamical information well away 
from this limit, and they split into subsets associated 
with different dynamical effect. They allow one to in- 
dentify collective degrees of freedom responsible for on 
one hand the advanced partial synchronization and on 
the other the inhibition of complete synchronization in a 
highly clustered scale-free network. Connections among 
topology, spectrum and dynamics will be explored more 
fully in a future publication, which will apply the for- 
malism to other types of networks including ones with 
unequal and asymmetric couplings a^-, as well as con- 
sidering other spectral properties such as the localization 
and delocalization of modes. 
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